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A quantum many-body system which is prepared in the ground state of an integrable Hamiltonian 
does not directly thermalize after a sudden small parameter quench away from integrability. Rather, 
it will be trapped in a prethermalized state and can thermalize only at a later stage. We discuss 
several examples for which this prethermalized state shares some properties with the nonthermal 
steady state that emerges in the corresponding integrable system. These examples support the 
notion that nonthermal steady states in integrable systems may be viewed as prethermalized states 
that never decay further. Furthermore we show that prethermalization plateaus are under certain 
conditions correctly predicted by generalized Gibbs ensembles, which are the appropriate extension 
of standard statistical mechanics in the presence of many constants of motion. This establishes that 
the relaxation behaviors of integrable and nearly integrable systems are continuously connected and 
described by the same statistical theory. 



I. INTRODUCTION 

Quantum statistical mechanics can successfully predict 
the equilibrium properties of a system with many degrees 
of freedom, based only on a few macroscopic parameters 
such as energy, volume, and particle number. These pre- 
dictions are obtained as averages over an ensemble of 
identical systems in which, according to the fundamen- 
tal postulate of statistical mechanics, each accessible mi- 
crostate is equally probable. The ensemble is described 
by a statistical operator p (with Tr[p] = 1) which maxi- 
mizes the entropy S = — Tr[/51n p\. In the microcanonical 
ensemble p projects onto states with the correct macro- 
scopic energy, but energy or other constants of motion 
can also be fixed only on average, as in the canonical 
or grand-canonical Gibbs ensemble. 1,2 For macroscopic 
systems, the difference between the predictions of these 
standard ensembles is usually negligible, and they all de- 
scribe the thermal state of the system in equilibrium. 
The statistical prediction for the equilibrium expectation 
value of an observable A is then Tr[/5A]. 

An ensemble describes a superposition of quantum 
states with classical probabilities and hence is a mixed 
state for which Tr[/5 2 ] < 1. Microscopically, however, a 
quantum system with Hamiltonian H (t) evolves accord- 
ing to the Schrodinger equation, ihj^\yj(t)) = H(t)\ip(t)). 
It is described by the density matrix p(t) = \tp(t)}(tp(t)\, 
i.e., a pure state with Tr[p(t) 2 ] = 1. This leads to the 
question how a disrupted quantum system can ever ther- 
malize, i.e., relax to a new equilibrium state which is de- 
scribed by a thermal ensemble with Tr[p 2 ] < 1, although 
this quantity is constant during the unitary time evolu- 
tion. There are two principal physical resolutions to this 
apparent mathematical paradox: (i) If the system is in 
contact with a (typically much larger) environment and 
only obscrvables of the system are of interest, then the en- 
vironment degrees of freedom can be traced out from p(t), 



leading to an effective statistical operator of the system 
that describes a mixed state, (ii) If the system is isolated 
(as we assume here) , then due to many-body interactions 
in the Hamiltonian the time evolution of \ip(t)) can be 
sufficiently 'crgodic' that for certain observables A the 
long-time limit of (A) t = (if,>(t)\A\ip(t)) indeed tends to 
the statistical prediction Tr[/5A]. Several possibly related 
concepts were developed to understand this behavior: 
Inspired by von Neumann's quantum ergodic theorem, 
the theory of typicality 3-10 puts bounds on the contribu- 
tions to (A) t that are far from the thermal value. The 
cigenstate thermalization hypothesis, 11-14 on the other 
hand, has relations to quantum chaos and posits that 
each eigenstate of H contributes to (A) 4 the microcanon- 
ical value at its eigenenergy. Another useful point of view 
is that even in an isolated system a large part of it can act 
as an environment for the smaller remainder. 15-20 More- 
over, thermalization has been related to the many-body 
localization transition. 21-23 

Recent progress in the manipulation of cold atomic 
gases has made it possible to prepare quantum many- 
body systems in excellent isolation from the environ- 
ment and to study their relaxation for a time-dependent 
Hamiltonian, 2 thus providing a laboratory realization 
of the situation (ii) above. In particular, oscillations be- 
tween Bose-condensed and Mott-insulating states after a 
steep sudden increase of the optical lattice depth 25 were 
observed. In one-dimensional bosonic gases the dynamics 
leading to thermalization were measured for two coher- 
ently split gases 26 and for a patterned initial state. 27 On 
the other hand, a nonthermal steady state was reached 
for a one-dimensional trap in which the system is close 
to an integrable point. 28 These developments have led to 
many theoretical studies regarding the relaxation of iso- 
lated quantum many-body systems (for recent reviews, 
see Refs. 29-31). In the simplest setup, a quantum many- 
body system is studied after a sudden parameter change 
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("quench"). In this situation the time evolution for t > 
is governed by a time-independent Hamiltonian H, but 
the initial state at t — is not an eigenstate of H. Rather 
the system is typically prepared in the ground state or a 
thermal state of some other initial Hamiltonian Hq. Re- 
garding the behavior of isolated interacting quantum sys- 
tems after a global quench, three main cases can be dis- 
tinguished: (a) Integrable systems which relax to a non- 
thermal steady state, 28-44 which often can be described 
by generalized Gibbs ensembles (GGE) that take their 
large number of constants of motion into account; 1,2,34 
(b) nearly integrable systems that do not thermalize di- 
rectly, but instead are trapped in a prethermalized state 
on intermediate timescales, which can be predicted from 
perturbation theory; 45-48 and (c) nonintegrable systems 
which thermalize directly. 13,27,36,47,49 We review these 
three cases in Sec. II. 

Fig. 1 shows two examples for the cases (a) and (b) for 
which the transient behavior is qualitatively rather simi- 
lar. In particular, both the integrable and the nearly in- 
tegrable system enter a long-lived nonthermal state. This 
leads us to the question whether and how the two cases 
are related and which properties they share. Our main 
claim in this article is that (a) nonthermal steady states 
in integrable systems and (b) prethermalized states in 
nearly integrable systems are in precise correspondence, 
in the sense that both these nonthermal states are due 
to the existence of exact (in case (a)) or approximate 
(in case (b)) constants of motion (see Table I). We sup- 
port this claim by two types of evidence. On the one 
hand (Sec. Ill A) we discuss several examples for which 
the predicted prethermalization plateau of an observable, 
when evaluated for an integrable system, yields precisely 
its nonthermal stationary value. In other words, nonther- 
mal steady states in integrable systems can be understood 
as prethermalized states that never decay. On the other 
hand (Sec. IIIB) we obtain perturbed constants of mo- 
tion that are approximately conserved in a nearly inte- 
grable system, use them to construct the corresponding 
GGE, and show that it describes the prethermalization 
plateau for a certain class of observables. 50 It follows that 
integrable and nearly integrable systems are connected 
in the sense that their relaxation dynamics involve long- 
lived nonthermal states that are described by the same 
statistical theory. 



II. INTEGRABILITY VS. THERM ALIZATION 

A. Integrable systems: Nonthermal steady states 

If H is integrable it has a large number of constants 
of motion, and the system then usually relaxes to a non- 
thermal steady state. 28-44 This behavior is due to the fact 
that expectation values of all the constants of motion do 
not change with time. Therefore not all microstates in 
the relevant energy shell are in fact accessible, so that 
the above-mentioned fundamental postulate of statisti- 
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(b) Hubbard model (nearly integrable) 
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FIG. 1. Relaxation of the momentum occupation nu a af- 
ter an interaction quench from U = to U = 0.5 in (a) 
the Falicov-Kimball model 40 and (b) Hubbard model in it- 
erated perturbation theory, 47 obtained in dynamical mean- 
field theory (DMFT) for a momentum k which is outside 
the Fermi surface (en, = 0.5, half-filled band with semiellip- 
tic density of states, bandedges at —2 and 2). In the inte- 
grable Falicov-Kimball model a nonthermal long-time limit 
is observed, whereas in the nearly-integrable weak-coupling 
Hubbard model a prethermalization plateau occurs (which 
is predicted to good accuracy by second-order perturbation 
theory, 46 cf. Sec. II B), with subsequent relaxation towards 
the thermal value. For technical reasons the time evolution 
in (a) starts from a low-temperature thermal state. Further 
results for Falicov-Kimball and Hubbard models are discussed 
in Sec. Ill A. 



cal mechanics cannot be expected to give a reliable de- 
scription of the steady state. In contrast to the classi- 
cal case it is not obvious whether a given Hamiltonian 
is integrable, because any quantum Hamiltonian always 
has as many constants of motion as the dimension of 
the Hilbert space, e.g., its powers, or the projectors onto 
its eigenstates. 13,37 ' 51,52 Many solvable Hamiltonians H, 
however, are integrable in a stronger sense, namely they 
can be mapped, H — > i? e ff, onto a effective Hamiltonian 
of the form 



H, 



eff : 



E 



(i) 



with [i a ,ip] = for all a and j3 and thus [H,X a ] = 0, 
where L is proportional to the system size rather than 
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TABLE I. Nonthermal (quasi-)stationary states after a quench to an integrable or nearly integrable Hamiltonian H. 





Hamiltonian H after quench 


(quasi-)stationary state 


(a) integrable case 


H integrable with exact constants of motion 


nonthermal steady state in the 
long-time limit, t — s- oo 


(b) nearly integrable case 


H = H + gH-i, \g\ < 1, H integrable, 

H not integrable with approx. constants of motion 


prethermalized state for intermediate 
times t with <S const • t <C g~ 2 



the dimension of the Hilbert space of H c s- Typically the 
constants of motion I a have integer eigenvalues that can 
be represented by fermionic or bosonic number operators, 
ia = o- a a a- ^ n these cases H c g describes dressed degrees 
of freedom that arc noninteracting and have a simple time 
dependence. On the other hand, after transforming back 
the resulting time dependence of the original degrees of 
freedom is usually nontrivial. 

Examples for models that can be solved on the 
Hamiltonian level as in Eq. (1) include hard-core 
bosons in one dimension or XY spin chains, which 
can be mapped to noninteracting fcrmions by a 
Jordan- Wigncr transformation, 32-34,53-55 the Tomonaga- 
Luttinger model which corresponds to an effective 
free-boson Hamiltonian, 35,56 a one-dimensional electron- 
phonon model, 44 and the 1/r Hubbard chain. 41 ' 57,58 The 
Falicov-Kimball model 40,42,59 is also integrable in the 
sense that for a fixed equilibrium configuration of im- 
mobile particles the Hamiltonian is quadratic and can be 
diagonalizcd into the form (1). 

For effectively free Hamiltonians such as (1) a statis- 
tical prediction for the nonthermal steady state can be 
made with an appropriate GGE, 1,2,34 

Pg = " > Z g = Tr[e-^ , (2) 

Z G 

which maximizes the entropy with the constants of mo- 
tion set to the correct average, (I q )g = (Z a )t=o, by 
means of the Lagrange multipliers X a . 2 The purpose 
of these additional constraints is to take into account 
(on average) that many microstates are inaccessible dur- 
ing the time evolution because they are incompatible 
with the values of the conserved quantities in the ini- 
tial state. GGEs correctly predict many (but not all) 
properties of nonthermal steady states in various in- 
tegrable models. 29,34 ' 38 ' 39,41,43 ' 44 A microcanonical ana- 
logue of Eq. (2), the so-called generalized microcanonical 
ensemble, was also studied. 60 



B. Nearly integrable systems: Prethermalization 

Now consider the case that the Hamiltonian H after 
the quench is not exactly integrable but close to an inte- 



grable point with Hamiltonian Ho, i.e., 

H = H Q + gH! , (3a) 

L 

Ho = Y ta ^ a ' ( 3b ) 

c*=l 

with \g\ <C 1, i.e., now the full Hamiltonian H is almost 
but not exactly of the form (1). In this case the re- 
laxation dynamics is nevertheless strongly influenced by 
the near-intcgrability, i.e., due to the presence of approx- 
imate constants of motion, as discussed in more detail 
below. In such cases the system prethermalizes, i.e., (A) 
relaxes first to a nonthermal quasistationary value A sta t 
state that is increasingly long-lived as H approaches the 
integrable point at g = 0. One of the characteristic fea- 
tures of prethermalization, known from field theory, 45 is 
that integrated quantities such as kinetic and potential 
energy attain their thermal values much earlier than in- 
dividual occupation numbers. This phenomenon was re- 
cently studied in detail for Fermi liquids by Moeckel and 
Kehrein, 46 namely for interaction quenches from U = 
to small values of U > in the fermionic Hubbard model 
with Hamiltonian 

H = %4a ct + u fti t% » ( 4 ) 

iju i 

which for U = reduces to an integrable Hamilto- 
nian (3b) in which the momentum occupation numbers 
hka = ^ka^ku pl a Y the role of the conserved quantities 

T 

_t. a • 

It was stressed in Ref. 46 that in analogy to classi- 
cal mechanics naive perturbation theory leads to secular 
terms that grow polynomially in time; instead instead 
one should use unitary perturbation theory, i.e., absorb 
the perturbation by a unitary transformation, perform 
the time evolution, and transform back. In Appendix A 
we derive a simple form of unitary perturbation theory 
(already used in Ref. 46) for a nondegeneratc Hamilto- 
nian Hq. If the time evolution is governed by the a nearly 
integrable Hamiltonian H [Eq. (3)], we obtain the expec- 
tation value of an observable A as (see Appendix B 1) 

(A) t = (i)o + 4.g 2 | Sln ^ /2) m + 0(g 3 ) , (5) 

— oo 

where the function J (to) depends on the observable A and 
the initial state |^(0)). In the case that (i) A commutes 
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with all constants of motion X a and (ii) the initial state 
■0(0)) is an eigenstatc of Hq, it can be written as 

J(u) = (Hi (A - (i) ) 5(H - (H ) - u) ffi) . (6) 

These two assumptions (i) and (ii) are merely made to 
obtain the compact result (6); it is straightforward to ex- 
tend the analysis to any observable and any initial state. 
We note that an evaluation (see Appendix B2) of (hkcr)t 
according to Eqs. (5-6) for quenches from to small U 
in the fermionic Hubbard model [Eq. (4)] recovers the 
result obtained with flow equations for continuous uni- 
tary transformations. 46 The prethermalization plateau, 
denoted by Atat, can be obtained as the long-time aver- 
age of Eq. (5), linif-^oo f Q dt'/t (A) t >, assuming that \g\ is 
so small that the scales l/\g\ and 1/g 2 are well separated 
and the limit t —> oo is taken in the sense that l/\g\ <C 
const ■ t <C 1/.9 2 : 46 



A s tat = (A)o + 2g 2 I % J( w ) + 0(g 3 ) . (7) 



mechanism for thermalization, is still being developed 
and debated. 3-23,63 Interestingly, signatures of thermal- 
ization were also found for certain variables in integrablc 
systems. 64 



III. INTEGRABLE VS. NEARLY INTEGRABLE 
SYSTEMS 

Our main claim in this article is the close correspon- 
dence between (a) nonthermal stationary values in in- 
tegrable systems, i.e., (Aoo = lim^oo (A) t , and (b) 
prethermalization plateaus Atat in nearly integrable sys- 
tems. In Sec. Ill A we discuss several examples for which 
the predicted prethermalization plateau of an observ- 
able (7), when evaluated for an integrable system of 
type (1), yields precisely its nonthermal stationary value. 
We then obtain in Sec. IIIB that prethermalized states 
are described by an appropriate GGE built from ap- 
proximate constants of motion, analogous to nonthermal 
steady states in integrable systems that are described by 
a GGE built from exact constants of motion. 



If A commutes with all X a and \^p(0)) is an cigenstate of 
Hq, this expression simplifies to 



Atat = 2(i)o - (A) + 0(g 3 ) , 



(8) 



where (A)^ = (ip(fi)\A\ip(0)) denotes the expectation 

value in the perturbative eigenstate |?/>(0)) of H corre- 
sponding to the initial state 1-0(0)). 46 

In general Atat differs from the thermal expecta- 
tion value of A obtained with a microcanonical or 
canonical ensemble with the same average energy E 
as the quenched system, i.e., E = (ip(0)\H\ip(0)) = 
(ip(t)\H \ip(t)). Hence if subsequent thermalization oc- 
curs it is expected to be due to processes of order g 3 and 
higher and to happen at later times, t 3> i/g 2 . 46 - 48 . 61 
The prethermalization plateau (8) and also the predicted 
transient behavior (5) 46 were confirmed for hk a after in- 
teraction quenches in the Hubbard model in DMFT; 47 
later-stage relaxation towards the thermal values was also 
observed (see also Fig. lb). 



A. Nonthermal steady states in integrable systems 
are prethermalized states that never decay 

We now compare the two values At at [Eq. (7)] and 
(A)t=oo analytically or to high numerical accuracy for 
interaction quenches to weak and strong coupling in 
two Hubbard-type models, namely in the 1/r Hubbard 
chain 41 and the Falicov-Kimball model in DMFT (i.e., 
in the limit of infinite spatial dimensions), ' which are 
integrable in the sense of Eq. (1). For both models the 
Hamiltonian is of the form (4) (however, for the Falicov- 
Kimball model the hopping amplitude is zero for one of 
the spin species). As observable we consider the dou- 
ble occupation d = (%2 i hi\hi\)/L (L: number of lattice 
sites). We obtain d stat from Eq. (7) for these two inte- 
grable systems, and show that it agrees with the non- 
thermal stationary value (d)^. 



1. Weak coupling 



C. Nonintegrable systems: Thermalization 

For nonintegrable systems thermalization is expected 
for sufficiently long times because only few relevant con- 
stants of motion exist, and was observed in several 
systems. 13,27 ' 36,47 ' 49 Due to limitations in simulation time 
and/or system size it is sometimes difficult to deter- 
mine whether the required distance from an integrable 
point for which thermalization occurs is finite (as sug- 
gested, e.g., by the results of Refs. 36, 37, and 62) or 
infinitesimal in the thermodynamic limit (as suggested 
by a general analysis in Ref. 61) This issue, as well as the 



We first consider an interaction quench from to small 
values of U . Then the prethermalization plateau of hk a is 
given by Eq. (8), and d s t a t can be obtained using energy 
conservation after the quench. For the integrable 1/r 
Hubbard chain (with bandwidth W and particle density 
n < 1) we use known properties of the perturbed ground 
state |"0(O)} and obtain (see Appendix C) 

d^ = ~- \ w +0(U 2 ). (9) 

When comparing this predicted prethermalization 
plateau with the exact long-time limit (d)oo (Ref. 41) 



we see that both values agree to order U for all densities 
n < 1. For this integrable system Eq. (8) thus predicts 
the nonthermal stationary value instead of a prethcrmal- 
ization plateau. 



2. Strong coupling 

For interaction quenches from to large values of U 
the final Hamiltonian is also close to an integrable point, 
namely the atomic limit with conserved occupation num- 
bers cJ CT c i(T on each lattice site. However, we consider an 
initial Hamiltonian other than the atomic limit, so that 
Eqs. (6) and (8) do not apply. Instead, c? s tat is given by 
unitary strong-coupling perturbation theory 47 ' 65 as 



(d)o 



^ T 



UL 



fct c 



(n. lS -n, s ) 2 ) + O{U- 2 ) 



(10) 



valid for an arbitrary initial state |^>(0)). We note that 
for a nonintegrable system d s t a t was observed as the cen- 
ter of collapse-and-revival oscillations that occur after 
interaction quenches to large U in the Hubbard model in 
DMFT. 47 

For quenches from U = to large U in the integrable 
1/r Hubbard model Eq. (10) predicts: 47 



2(3 - 2n)W 
3f7 



+ o{u- 2 ). 



(11) 



Comparing this prediction with the exact long-time limit 
(e?)oo (Ref. 41) we find again that they are in agreement 
to order C/" 1 for all densities n < 1. 

Finally, for the Falicov-Kimball model in DMFT with 
a scmiclliptic density of states, the value <4tat predicted 
by Eq. (10) is 



"stat — — : 



n 2 (2 — n)n 



2U 



(H ) + O(U- 2 ). (12) 



Fig. 2 shows the exact double occupation (d) t for the 
Falicov-Kimball model in DMFT for quenches from to 
large U. In the long-time limit (d)t tends precisely to the 
predicted value (12) in the long-time limit large U. 



3. Summary 



"O 

4 





FIG. 2. Upper panel: Difference between the double oc- 
cupation (d)t and its initial value {d)o = 1/4 for quenches 
from the ground state (U = 0) to U = 10 and 80 in the 
Falicov-Kimball model in DMFT at half-filling, obtained from 
the exact solution for a semielliptic density of states with 
bandwidth 4 (Ref. 40, 42). For large U the oscillations take 
place inside a common envelope function. 47 The horizontal 
line corresponds to the stationary value d s tat to which {d)t 
is predicted to relax according to the strong-coupling expan- 
sion (10). Lower panel: The exact long-time limit {d)t (tri- 
angle symbols) compared to the stationary value d s tat of the 
strong-coupling expansion (10). 



nonthermal steady state as one quenches closer and closer 
to the integrable point. We cannot show this continuity 
in general, but provide a continuous statistical descrip- 
tion of integrable and nonintegrable systems in the next 
subsection. 



For these three examples of integrable Hubbard-typc 
systems we showed that prethcrmalizcd states, described 
by unitary perturbation theory for nearly integrable sys- 
tems, also describes the nonthermal steady state in in- 
tegrable systems. This suggests the viewpoint that non- 
thermal steady states in integrable systems are simply 
prethermalized states that never decay. In other words, 
the system appears to be trapped in essentially the same 
state both at and very close to an integrable point. This 
suggests that the prethermalized state approaches the 



B. Construction of approximate constants of 
motion for nearly integrable systems and the 
corresponding generalized Gibbs ensemble 

We now turn to the question whether for a small 
quench from an integrable point Hq to H = Hq + gH\ 
(with \g\ -c 1) the prethermalization plateau (8) is de- 
scribed by an appropriate Gibbs ensemble involving ap- 
proximate constants of motion. We use the eigenbasis 
\n) of the constants of motion, i.e., n = (m, n-x, • ■ • , nif), 
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2q|ti) = n a \n), and assume that the energies e a are in- 
commensurate, so that the eigenenergies E n = ^ Q e a n a 
of Hq are nondcgcncratc. This is not a strong restriction 
as the boundaries of the system can always be imagined 
to be so irregular as to lift all degeneracies. 

As described in Appendix A a unitary transformation 
e can be constructed which yields 

H = ^ € a I a 
a 

+ £ \n)(gE^ + g 2 E^){n\ + 0(g 3 ) , (13a) 

n 

= l a - 0X] + [S, 0X]} + 0(g 3 ) , (13b) 

where H\n) = E n \n), \n) = e~^\n), and En' 2 ^ are the 
standard energy corrections in first and second order 
perturbation theory, recovering the perturbed Rayleigh- 
Schrodinger energy eigenvalues, 

E n = E n +gE^+g 2 E^+0(g 3 ). (14) 

The structure of the transformed Hamiltonian is plau- 
sible: the first term on the left-hand side in Eq. (13a) 
retains the additive 'noninteracting' structure of the in- 
tcgrablc Hamiltonian Ho with the same 'one-particle' en- 
ergies e a , whereas the perturbative energy corrections are 
not additive in this way but rather depend explicitly on 
the configuration of the state e |n). Other perturbed 
Hamiltonians with a different structure were proposed in 
the literature, e.g., with modified energies e a , 6e or per- 
turbed energy eigenvalues E n that remain additive in the 
quantum numbers n a . 67 

Since [T a ,Tp] = [T a ,Zp] =0wc have [H,X a ] = 0(g 3 ), 

so that the I a are the desired approximate constants of 
motion that indeed commute with H to order g 2 . Note 
that in principle our canonical transformation can be con- 
tinued to arbitrary high order in g, but an accurate de- 
scription can nevertheless only be expected in a pertur- 
bative regime of sufficiently small g. Next we construct 
the corresponding GGE with these perturbed constants 
of motion, 

fa = — cxp (- A Q X«) , (15) 

G a 

where the X a are fixed by the initial state according to 

(Ia)g = TMPgZa:] = (Z a )o ■ (16) 

Here we choose only the conserved quantities T a that ap- 
pear linearly and additively in the Hamiltonian (13a) to 
construct the GGE. Note that the Hamiltonian (13a) is 
not precisely of the form (1) but rather contains addi- 
tional diagonal terms that involve the projectors |n)(n|. 



These projectors are in general nonlinear in the X a and 
are therefore not used in the GGE; the use of prod- 
ucts of conserved quantities in the GGE is discussed in 
Refs. 13, 38, and 41, but not pursued here. 

We now come to the central point of this article: we 
compare the prcthermalization plateau A sta t [Eq. (8)] of 
an observable A (assumed to have the initial state as an 
eigenvector and to commute with all I a ) with the sta- 
tistical prediction {A)q. We assume that the constants 
of motion I a can be represented by fermionic or bosonic 
number operators, I a = a\ t a al and that the integrability- 
breaking term H\ can be expressed as a linear combina- 
tion of products of these creation and annihilation oper- 
ators. (Otherwise Hi would involve operators that act 
on other spaces than Ho, so that Ho would have degen- 
eracies contrary to our assumption.) 

For simplicity let us first consider an observable A = 
T a , i.e., one of the conserved quantities of Ho (e.g., a 
momentum occupation number hka in a Hubbard-type 
model). Then we find (see Appendix D) that indeed 

2a,rtat = X)a + 0(.<? 3 ) . (17) 

This shows that the prethermalization plateau of the con- 
served quantities of H (which are no longer conserved 
during the time evolution with H = Ho + gH\) is pre- 
dicted correctly in order g 2 by the appropriate statistical 
theory [Eq. (15)]. Hence on timescales l/\g\ <C const • t 
•C l/g 2 the pure state \tp(t)} gives the same expectation 
values as a mixed state described by p^. For a more com- 
plicated observable, 

n 

A = l[X ai , (18) 

i=l 

we also find 

Art* = + 0(g 3 ) , (19) 
provided the condition 

n n 

( n^) 5 =n&'>6+°(s 3 ) ( 2 °) 

i=l i=l 

is fulfilled. This is due to the fact that the GGE pg is di- 
agonal in the I a and therefore cannot describe arbitrary 
correlations that are built up between two or more T ai , 
which is a well-known limitation. 38,39 ' 41 At the integrable 
point (g — and \ip(0)) = \ip(0))) the factorization con- 
dition (20) reduces to the condition derived in Ref. 41 
for the validity of a GGE (2) for an integrable Hamilto- 
nian (1). 

The above assumption about the structure of Hi en- 
sures that it does not contain operators that are absent 
in pg. Information about such operators would be miss- 
ing from the GGE ensemble (15), making their correct 
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description unlikely. However, this is not a strong restric- 
tion, as several coupled spaces can also be considered in 
a GGE (see, e.g., Ref. 44). 

We conclude that the phenomenon of prcthcrmaliza- 
tion not only means that a long-lived nonthermal state is 
attained prior to possible thermalization at a later stage, 
but also that the properties of the prethermalized state 
are predicted correctly by an ensemble that is constructed 
according to the principles of statistical mechanics. 



IV. CONCLUSION 

We argued that intcgrable and nearly intcgrable sys- 
tems are continuously connected in the following sense: 
(a) Integrable systems relax to nonthermal, but GGE- 
described stationary states; (b) Near-integrable systems 
arc trapped in quasistationary states due to the per- 
turbed constants of motion of the nearby integrable sys- 



tem, and can also be described by an appropriate per- 
turbed GGE. Hence if one studies the relaxation of a 
nonintcgrable system closer and closer to an integrable 
point, the prethermalization plateau will survive longer 
and longer and will approach the nonthermal long-time 
limit at the integrable point, with the appropriate GGE 
describing this steady state throughout. 

Previously GGEs were only used to describe integrable 
systems. Here we showed that GGEs can make valid pre- 
dictions also away from integrable points, at least pertur- 
batively. In our opinion this illustrates the power of sta- 
tistical mechanics, which makes correct predictions pro- 
vided that the observables are not too complicated and 
only the accessible phase space is included in the statis- 
tical operator. 
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APPENDIX 



Appendix A: Unitary perturbation theory 

We use a canonical transformation e s , similar to 
Ref. 46, which reproduces second-order Rayleigh-Schro- 
dinger perturbation theory at the operator level and thus 
enables us to construct the approximate constants of mo- 
tion of H = Ho + gH\. We expand the antihermitian 
operator S in powers of g, 



S = gSi + \g 2 S 2 + 0(g 3 ) , 
and apply the canonical transformation to H , 



(Al) 



e s He- s = H + + [Si,H ]) + g 2 ( ^[S 2 ,H ] 

+ 0(g 3 ). (A: 



The transformed Hamiltonian shall still have all I a as 
constants of motion, i.e., we demand [e s He~ s ,I a ] = 
for all a, order by order. We use the basis I a \n) = 
n a \n) and assume that the energies e a are incommensu- 
rate, so that the eigcnenergies E n = ^ Q £ a n a of H are 



nondegenerate. To second order in g we obtain for the 
transformed Hamiltonian and the unitary transformation 



H diae = e S He~ § = H + gH^ g + g 2 H^ + 0(g 3 ) , 
(n\Hi\m) 



(n|5i|m) = { E n — R. 



if n ^ m 



{n\S 2 \m) 

r(i) 



if n = m 

(n\[S u H 1+ H^ g ]\m) 

En ~~ Em 



HZ s = J2\n)R^(n\, 



diag 

Eg 



(nfaln), R&= 



if n m 
if n = m 

Km|£x|n>| 2 



from which the eigenvalues E n [Eq. (14)] of the eigen- 
states \n) = e~ s \n) can be read off. 
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Appendix B: Transients in nearly integrable systems 
1. Derivation of Eqs. (5), (6), (8) 

Here wc obtain the transient behavior in second or- 
der unitary perturbation theory, in close analogy to the 
derivation in Ref. 46. We assume that the initial state is 
an eigenstate of Ho, 

|V(0)> = \p) , (Bl) 

I a \p) — p a \p) , and that the observable A commutes with 
all constants of motion I a . For now we set (A)o = 
and reinstate a possibly nonzero initial value at the end. 
Inserting the unitary transformation for the Hamiltonian 
we obtain 

(A) t = (p\e i6t Ae- iAt \p) 

= (p\e- S e iiidi ^ t e § Ae- § e- i6 ' i ^ t e § \p) 

= (p\e- § e § WAe- § We § \p) , (B2) 

with the abbreviation S(t) = e lHdia z t Se~' lHdiast . Expand- 
ing the inner transformation as 

e S(t)i e -S(t) = A + A ] + l[ S (fy [S(t),A]] + 0(g 3 ) 

(B3) 

and then similarly expanding the outer back transforma- 
tion, we have 

(A) t = (p\a + [S(t) -S,A}- [S(t) - s, A}} 

+ ±{S(t),{S(t),A}}\p)+0(g 3 ) 

= -(p\(S(t) - S)A(S(t) - S)\p) + 0(g 3 ) 

= -2(p\sAs\p) + 2Rc(p\sAs(t)\p) + 0{g 3 ) . 

(B4) 

Here and below wc frequently use that A annihilates \p), 
A commutes with ifdiag, and \p) is an eigenstate of -ffdiag- 
In the second term of the last equation we can rewrite 

( P \sAs(t)\p) 

= - MS^^A^e- 1 ^-^ 1 

oo 

= ~ 9 I ^J^^ + Oig 3 ), (B5) 

— OO 

Here wc have defined 

J(cu) = J2 \{p\Hi\n)\ 2 {n\A\n)5{u-{E n -E p )) 

Tl(/p) 

= (pimAsiui - (Ho - (Ho))) Hi\p) , (B6) 



as in Eq. (6). By setting t — in Eq. (B5) we obtain a 
similar expression for the first term in Eq. (B4), which 
leads to Eq. (8). Eq. (B5) then also yields 

oo 

(i) t =. 9 2 JduUM ^WV +Otf), (B7) 

— oo 

as in Eq. (5). 

2. Evaluation for a small two-body interaction 
quench in a Fermi gas 

Here we evaluate the function J(uj) for a two-body in- 
teraction quench, i.e., 

for fermionic operators, {c Q , cjj} = 5 a p and {c a , c^} = 0; 
hence V a p y s = -Vp a ~/8 = —V a ps 7 = Vp a s 7 and V a p 1 s = 
= (Vsypa)*- The occupation numbers n a = c a c a (with 
eigenvalues 0, 1) play the role of constants of motion I a of 
the unperturbed system (a Fermi gas) before the quench. 
As observable we choose the change in the occupation 
number of a state [i, 

A=X ii - (J M ) = - , (B9) 
where \ip(0)) = \p) is the initial state with I a \p) = Pa\p)- 

(n„ - Pll )S(u - (Ho - E p ))c a clc 7 c s \p) , (BIO) 

where Hq — E p inside the delta function evaluates to e Q 
+ ep — e 7 — eg. In the initial state the single-particle 
level pb may be occupied (p M = 1) or unoccupied ( Pfl = 0), 
and inside the sum the operator (n^ — p^) must yield a 
nonzero contribution. Wc consider first p^ = 1, in which 
case this requirement leads to a factor 

x (1 - <5 7V )(1 - 8 slf _ t )(S a ^(l - Sp'fj) + <5/3>(l - £ a ' M )) ■ 

Using the symmetries of V a p y s we obtain the following 
contribution to J(w), 

~Pn E ^IJ.P'l'S'VaP^n x 
olP~i ft' 5' 

S(e a + ep - e 7 - e M - u) ^c^c^c^c^p) . (Bll) 
Next for p M = we find the factor 

(tianQ- ~ <W) + - <W))(1 _ ^7A»)(1 _ 

x (1 - (5 Q> )(1 - Sp^)(SYn(l - £<5'a0 + Ss'fj,(l - Sy'p)) , 
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so that the contribution to J(u>) is 

a/97/9 7 S 

<5(e M + e/j - e 7 - e<5 - w) (p|4'4'S'4s 6 «l p ) ■ ( B12 ) 

Evaluating the expectation values in Eqs. (Bll) 
and (B12) in the product state \p) by contractions we 
finally obtain 



J(u) 



+ (l-P/0 



16 5^(1 - p a ) \W atl \ 2 5(e a - e M - a. 

+ 8 X! |K*/3 7 ^| (1 -Pa)(l ~Pp)jh 

a/37 

x <5(e Q + - e 7 - e p - w 
16 IM^q^I 2 <5(e/3 - e M — w) 

a/37 

x <5(e a + - e 7 - - w) 



with the abbreviation 

W a)1 = ^V a pp ll pp 



, (B13) 



(B14) 



where p ka are the momentum occupation numbers in the 
initial state. When inserted into Eq. (5) this leads to the 
same expression for the transient behavior that Moeckel 
and Kehrein 46 obtained using continuous unitary trans- 
formations, but here we used only a single unitary trans- 
formation. 



Appendix C: Properties of the weak-coupling 
ground state of the 1/r Hubbard chain 

For the 1/r Hubbard chain the kinetic energy per lat- 
tice site €kin(y) can be obtained from the fact that the 
ground-state energy is given by the variational Gutzwillcr 
energy up to 0([/ 2 ), 58 which yields (W: bandwidth, L 
= number of lattice sites) 



ha 



(Cl) 



n(2-n)W n 2 (2n-3)[/ 2 



4 12W ' \W 2 )' 

For a quench from to U the prethermalization plateau 
of each momentum occupation number h ka is given by 
Eq. (8). Using the fact that the total energy is conserved 
after the quench, the prethermalization plateau of the 
double occupation d is then given by 

4tat = {d) - |[ekin(E0 - ekin(O)] + 0(U 2 ) , (C2) 
which, together with Eq. (Cl), yields Eq. (9). 



Appendix D: GGE prediction for prethermalization 
plateaus [Derivation of Eqs. (17), (20)] 



For completeness we now evaluate Eq. (B13) for the ob- 
servable h ka in the Hubbard model (4) by setting a = 
(fci,CTi) etc., 

Va^s = ^A(ki + k 2 + k 3 + fe 4 ) 

), (B15) 



so that in particular V a pps = 0, W ail = 0. Here A(k) 
= S k ,G is the von-Laue function involving reciprocal 
lattice vectors G. Eq. (B13) then takes the form 

U 2 

Jka(0j) = -J^ A(k! + k 2 - k 3 - k) 



feifeafe3 

<Tl(T2<73 



x 5(e kl + £fc 2 - £fc 3 - e k - w) 

(1 -pfe lCTl )(l - Pk 2 a 2 )Pk 3 a 3 Pka 
' Pk 1 a 1 Pk 2 cr 2 {± ~ Pk 3 cr 3 



, (B16) 



In the following derivation of Eqs. (17), (20) we re- 
peatedly use Eq. (16) which fixes the Lagrange multipli- 
ers. Several transformations between the eigenbases of 

the l a and the I a are performed. We have 



Tr[A< 



Tr[ e -£«A«x«] 
= (A+[S,A] + ±[S,[S,A]]) G +0(.g 3 ), (Dl) 

where (-} G denotes the GGE expectation value (2) but 
with the X a still fixed by Eq. (16). We proceed to eval- 
uate the three terms in (A)~ for an observable of the 
form (18). The first term can be rewritten as 

/ m \ m m 

(i) G = / nx ai \ = n^) G = n^)c 

\i=l / G i=l i=l 
m A m. 

=n<i ! )o=n^)o+o(g 3 ), (D2) 
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the second term vanishes, and the third term becomes 

(fts, [s,A]]) G 

VW§&.&.4]I»»> + O (0 3 ) -■ 



z. 



= E 

= 5 2 F({(i Q ) G })+0(.g 3 ) 

= 5 2 F({(l)o})+0( 5 3 ) 
= .g 2 F({(i Q )o})+0(. 9 3 ) 
= 5 2 (i[5 l! [5 1 ,i]])o + 0( fl 3 ) 
= <±[S, [S 7 A}]) + O(g 3 ) 
= (A)~ Q - (i) + 0(g 3 ) 

m m 

= <IIia i )o-II<2a 1 >0 + Oa? 3 ) (D3) 



In the second step we have used that H\ involves only 
the creation and annihilation operators that occur in Hq 
so that Wick's theorem can be applied, yielding some 
function F of the occupation numbers, which are then 
related to initial-state expectation values in leading order 
in g. Then F is eliminated by applying Wick's theorem 
backwards. Finally, equating Eqs. (8) and (Dl) yields 
the condition (20). 



